Towards predicting post-editing productivity

Machine translation (MT) quality is generally measured via automatic metrics, producing scores that have no meaning for translators who are required to post-edit MT output or for project managers who have to plan and budget for transla- tion projects. This paper investigates correlations between two such automatic metrics (general text matcher and translation edit rate) and post-editing productivity. For the purposes of this paper, productivity is measured via processing speed and cognitive measures of effort using eye tracking as a tool. Processing speed, average fixation time and count are found to correlate well with the scores for groups of segments. Segments with high GTM and TER scores require substantially less time and cognitive effort than medium or low-scoring segments. Future research involving score thresholds and confidence estimation is suggested

Interactive translation prediction versus conventional post-editing in practice: a study with the CasMaCat workbench

[EN] We conducted a field trial in computer-assisted professional translation to compare interactive translation prediction (ITP) against conventional post-editing (PE) of machine translation (MT) output. In contrast to the conventional PE set-up, where an MT system first produces a static translation hypothesis that is then edited by a professional (hence "post-editing"), ITP constantly updates the translation hypothesis in real time in response to user edits. Our study involved nine professional translators and four reviewers working with the web-based CasMaCat workbench. Various new interactive features aiming to assist the post-editor/translator were also tested in this trial. Our results show that even with little training, ITP can be as productive as conventional PE in terms of the total time required to produce the final translation. Moreover, translation editors working with ITP require fewer key strokes to arrive at the final version of their translation.This work was supported by the European Union’s 7th Framework Programme (FP7/2007–2013) under grant agreement No 287576 (CasMaCat ).Sanchis Trilles, G.; Alabau, V.; Buck, C.; Carl, M.; Casacuberta Nolla, F.; Garcia Martinez, MM.; Germann, U.... (2014). Interactive translation prediction versus conventional post-editing in practice: a study with the CasMaCat workbench. Machine Translation. 28(3-4):217-235. https://doi.org/10.1007/s10590-014-9157-9S217235283-4Alabau V, Leiva LA, Ortiz-Martínez D, Casacuberta F (2012) User evaluation of interactive machine translation systems. In: Proceedings of the 16th Annual Conference of the European Association for Machine Translation, pp 20–23Alabau V, Buck C, Carl M, Casacuberta F, García-Martínez M, Germann U, González-Rubio J, Hill R, Koehn P, Leiva L, Mesa-Lao B, Ortiz-Martínez D, Saint-Amand H, Sanchis-Trilles G, Tsoukala C (2014) Casmacat: A computer-assisted translation workbench. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp 25–28Alves F, Vale D (2009) Probing the unit of translation in time: aspects of the design and development of a web application for storing, annotating, and querying translation process data. Across Lang Cultures 10(2):251–273Bach N, Huang F, Al-Onaizan Y (2011) Goodness: A method for measuring machine translation confidence. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp 211–219Barrachina S, Bender O, Casacuberta F, Civera J, Cubel E, Khadivi S, Lagarda AL, Ney H, Tomás J, Vidal E, Vilar JM (2009) Statistical approaches to computer-assisted translation. Comput Linguist 35(1):3–28Brown PF, Della Pietra SA, Della Pietra VJ (1993) The mathematics of statistical machine translation: parameter estimation. Comput Linguist 19(2):263–311Callison-Burch C, Koehn P, Monz C, Post M, Soricut R, Specia L (2012) Findings of the 2012 workshop on statistical machine translation. In: Proceedings of the Seventh Workshop on Statistical Machine Translation, pp 10–51Carl M (2012a) The CRITT TPR-DB 1.0: A database for empirical human translation process research. In: Proceedings of the AMTA 2012 Workshop on Post-Editing Technology and Practice, pp 1–10Carl M (2012b) Translog-II: a program for recording user activity data for empirical reading and writing research. In: Proceedings of the Eighth International Conference on Language Resources and Evaluation, pp 4108–4112Carl M (2014) Produkt- und Prozesseinheiten in der CRITT Translation Process Research Database. In: Ahrens B (ed) Translationswissenschaftliches Kolloquium III: Beiträge zur Übersetzungs- und Dolmetschwissenschaft (Köln/Germersheim). Peter Lang, Frankfurt am Main, pp 247–266Carl M, Kay M (2011) Gazing and typing activities during translation : a comparative study of translation units of professional and student translators. Meta 56(4):952–975Doherty S, O’Brien S, Carl M (2010) Eye tracking as an MT evaluation technique. Mach Transl 24(1):1–13Elming J, Carl M, Balling LW (2014) Investigating user behaviour in post-editing and translation using the Casmacat workbench. In: O’Brien S, Winther Balling L, Carl M, Simard M, Specia L (eds) Post-editing of machine translation: processes and applications. Cambridge Scholar Publishing, Newcastle upon Tyne, pp 147–169Federico M, Cattelan A, Trombetti M (2012) Measuring user productivity in machine translation enhanced computer assisted translation. In: Proceedings of the Tenth Biennial Conference of the Association for Machine Translation in the AmericasFlournoy R, Duran C (2009) Machine translation and document localization at adobe: From pilot to production. In: Proceedings of MT Summit XIIGreen S, Heer J, Manning CD (2013) The efficacy of human post-editing for language translation. In: Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pp 439–448Guerberof A (2009) Productivity and quality in mt post-editing. In: Proceedings of MT Summit XII-Workshop: Beyond Translation Memories: New Tools for Translators MTGuerberof A (2012) Productivity and quality in the post-editing of outputs from translation memories and machine translation. Ph.D. ThesisJust MA, Carpenter PA (1980) A theory of reading: from eye fixations to comprehension. Psychol Rev 87(4):329Koehn P (2009a) A process study of computer-aided translation. Mach Transl 23(4):241–263Koehn P (2009b) A web-based interactive computer aided translation tool. In: Proceedings of ACL-IJCNLP 2009 Software Demonstrations, pp 17–20Krings HP (2001) Repairing texts: empirical investigations of machine translation post-editing processes, vol 5. Kent State University Press, KentLacruz I, Shreve GM, Angelone E (2012) Average pause ratio as an indicator of cognitive effort in post-editing: a case study. In: Proceedings of the AMTA 2012 Workshop on Post-Editing Technology and Practice, pp 21–30Langlais P, Foster G, Lapalme G (2000) Transtype: A computer-aided translation typing system. In: Proceedings of the 2000 NAACL-ANLP Workshop on Embedded Machine Translation Systems, pp 46–51Leiva LA, Alabau V, Vidal E (2013) Error-proof, high-performance, and context-aware gestures for interactive text edition. In: Proceedings of the 2013 annual conference extended abstracts on Human factors in computing systems, pp 1227–1232Montgomery D (2004) Introduction to statistical quality control. Wiley, HobokenO’Brien S (2009) Eye tracking in translation process research: methodological challenges and solutions, Copenhagen Studies in Language, vol 38. Samfundslitteratur, Copenhagen, pp 251–266Ortiz-Martínez D, Casacuberta F (2014) The new Thot toolkit for fully automatic and interactive statistical machine translation. In: Proceedings of the 14th Annual Meeting of the European Association for Computational Linguistics: System Demonstrations, pp 45–48Plitt M, Masselot F (2010) A productivity test of statistical machine translation post-editing in a typical localisation context. Prague Bulletin Math Linguist 93(1):7–16Sanchis-Trilles G, Ortiz-Martínez D, Civera J, Casacuberta F, Vidal E, Hoang H (2008) Improving interactive machine translation via mouse actions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp 485–494Simard M, Foster G (2013) Pepr: Post-edit propagation using phrase-based statistical machine translation. In: Proceedings of MT Summit XIV, pp 191–198Skadiņš R, Puriņš M, Skadiņa I, Vasiļjevs A (2011) Evaluation of SMT in localization to under-resourced inflected language. In: Proceedings of the 15th International Conference of the European Association for Machine Translation, pp 35–4

Reproductive tract infections in women seeking abortion in Vietnam

<p>Abstract</p> <p>Background</p> <p>Women requesting abortion are at increased risk of developing RTI complications. However, RTI control in many resource-poor countries including Vietnam have been faced with logistical and methodological problems due to lack of standardized definitions of RTIs, lack of well-validated diagnostic criteria, lack of accurate laboratory tests, and lack of diagnostic equipment and skills. This article investigates the prevalence of RTIs among Vietnamese abortion-seeking women, to evaluate the available diagnostic techniques, and to assess antibiotic resistance among aetiological agents of RTI.</p> <p>Method</p> <p>The study was conducted in Phu-San hospital (PSH) from December 2003 through April 2004 among 748 abortion clients. A structured questionnaire was used to collect data on socio-economic and reproductive characteristics. Specimens were collected for laboratory analyses of chlamydia, gonorrhoea, trichomoniasis, vaginal candidiasis (VC), bacterial vaginosis (BV) and syphilis. To assess the validity of the obtained results, the study was repeated among 100 women and the duplicate samples were analysed at PSH and Copenhagen University Hospital (CUH).</p> <p>Results</p> <p>In all 54% of the women were diagnosed as having an RTI, including 3.3% with sexually transmitted infections. Endogenous infections were most prevalent (VC 34% and BV 12%) followed by chlamydia (1.3%) and trichomoniasis (0.7%). The sensitivity of culture for VC and BV was 30% and 88%, respectively, when tests in PSH were measured against tests in CUH. Antibiotic resistance was common among bacterial isolates.</p> <p>Conclusion</p> <p>RTIs are common among women seeking abortion. The presence of RTIs is associated with an increased risk of developing iatrogenic infections, routine administration of prophylactic antibiotic to all women undergoing abortion should be considered. However, the choice of routine prophylactic antibiotics should be based on relevant surveillance data of antibiotic resistance. Moreover, since the accuracy of diagnosis is doubtful and to address the problem of under-diagnosed and treated RTIs new investment in diagnostic facilities with simple performed microscopy or improved rapid tests should also be taken into consideration.</p

Comparing sexual risks and patterns of alcohol and drug use between injection drug users (IDUs) and non-IDUs who report sexual partnerships with IDUs in St. Petersburg, Russia

<p>Abstract</p> <p>Background</p> <p>To date, the great majority of Russian HIV infections have been diagnosed among IDUs and concerns about the potential for a sexual transmission of HIV beyond the IDU population have increased. This study investigated differences in the prevalence of sexual risk behaviors between IDUs and non-IDUs in St. Petersburg, Russia and assessed associations between substance use patterns and sexual risks within and between those two groups.</p> <p>Methods</p> <p>Cross-sectional survey data and biological test results from 331 IDUs and 65 non-IDUs who have IDU sex partners were analyzed. Multivariate regression was employed to calculate measures of associations.</p> <p>Results</p> <p>IDUs were less likely than non-IDUs to report multiple sexual partners and unprotected sex with casual partners. The quantity, frequency and intensity of alcohol use did not differ between IDUs and non-IDUs, but non-IDUs were more likely to engage in alcohol use categorized as risky per the alcohol use disorders identification test (AUDIT-C). Risky sexual practices were independently associated with monthly methamphetamine injection among IDUs and with risky alcohol use among non-IDUs. Having sex when high on alcohol or drugs was associated with unprotected sex only among IDUs.</p> <p>Conclusions</p> <p>Greater prevalence of sexual risk among non-IDUs who have IDU sex partners compared to IDUs suggests the potential for sexual transmission of HIV from the high-prevalence IDU population into the general population. HIV prevention programs among IDUs in St. Petersburg owe special attention to risky alcohol use among non-IDUs who have IDU sex partners and the propensity of IDUs to have sex when high on alcohol or drugs and forgo condoms.</p

Business Ethics: The Promise of Neuroscience

Recent advances in cognitive neuroscience research portend well for furthering understanding of many of the fundamental questions in the field of business ethics, both normative and empirical. This article provides an overview of neuroscience methodology and brain structures, and explores the areas in which neuroscience research has contributed findings of value to business ethics, as well as suggesting areas for future research. Neuroscience research is especially capable of providing insight into individual reactions to ethical issues, while also raising challenging normative questions about the nature of moral responsibility, autonomy, intent, and free will. This article also provides a brief summary of the papers included in this special issue, attesting to the richness of scholarly inquiry linking neuroscience and business ethics. We conclude that neuroscience offers considerable promise to the field of business ethics, but we caution against overpromise